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Background Note 



The puT]:)Ose of this report is to summarize data coUecttxi on behalf 
of the Research and Evaluation Division, Project Head Start, Office of 
Economic Opportunity. The data reported and discussed here were com- 
piled on the Summer 1966 Project Head Start program under provisions of 
a contract between Educational Testing Service and the OBO. 

The portion of the contracted work reported in this section deals 
primarily with investigation of the relationships between pupil and pro- 
gram characteristics and pupil outcomes on certain prescribed instruments 
and other newly developed instruments. As contractor, ETS was requested 
to (a) collect ^^eard-post^^ pupil performance daua on all children in 
selected classrooms; (b) conduct and record intensive observations of 
these classrooms; (c) appraise involvement of parents in the progi'am; 
and (d) perform such statistical analyses as might be necessary to de- 
termine the relationships among the measured variables. 

In cooperation with the Research and Evaluation Division of Project 
Head Start a design for analysis of all data collected was prepared. This 
design was guided by a list of research and evaluation questions provided 
by personnel from Project Head Start with suggested amendments by ETS 
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The following pages, with technical appendices, represent the Final 

Report of work completed under the arrangements noted above. 
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Simimary of Highlights of this Section 

* 

(Project Head Start — Summer 1966) 

Pupils and Programs 

The classes (children) studied in summer 1966 Head Start programs, 
although still below established and desirable developmental per- 
formance on the widely-used Stanford-Binet intelligence test, per- 
foiined beyond what would be expected on the basis of the time 
intervening between observations. 

ft 

These same classes (children) on a newly developed inventory of 
behaviors (Project Head Start Behavior Inventory) were generally 
scoring positively at the beginning of the djistructional sessions 
and slightly more positively at the end. 

Summer 1966 Head Start classes (children) on the Preschool Inventory 
obtained higher total scores (and higher subscores) e.t the end of 
the instructional program than at the beginning. 

Teachers of Head Start classes were in general prepared and experi- 
enced. 

Classroom observed activities, although varied, were in the direction 
desired by child development experts. 

Parental evaluation and involvement in Head Start programs was high 
and positive. 

Only a few associations between specific differences in Head Start 
classes and amount of pupil change were noted. 
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FINAL REPORT 

There are very large differences in children admitted to Head Start 
centers and equally large differences in "graduates" of such programs. 

This truth is well known. And the need to present evidence of these 
differences is not great, although such evidence is of some interest to 
most readers. However, there is a need to look at this same infonnation 
in other ways when you wish to talk about possible effects of Head Start 
participation on children, • Specifically, we shall look at the informa- 
tion collected in order to describe children at the beginning of Head 
Start and at the end, and to point to particular changes observed. 

The actual instruments, used to observe children will lim it, of 
course, the portion of their development that can be discussed— many 
important areas of -personal growth, motivation, and success were not ob- 
served, All studies of human behavior draw the line somewhere in the 
interest of time or money or respect for individuals. The present study 
limited observation to two individual s'^ssions per child and two class- 
room observations of a nationwide sample of 79 classes with nearly 1,000 
pupils during the summer 1966 Head Start program. Therefore, no child 
nor class was interrupted for very long from the educational purposes of 
the program and most classes and children were not disturbed at all. In 
addition, information about teachers' experience and training and parental 
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knowledge of the local Head Stai^G effort was collected. 

C’Lasses were observed because they, just as children, also vary. 

There are different facilities and materials availablej teachers approach 
their responsibilities differently; and the curriculum is not so ordered 
or set as in more formal class situations. If changes were noted in the 
children of Head Start, it seemed sensible to see whether variations in 
programs were associated with these changes. The use of such information 
for future Head Start program planning will be discussed. Of course, in- 
formation about classroom differences is also limited to the actual obser- 
vations nvide from the unlimited number of possible observations that could 

have been made. 

The identification of reliable scientific knowledge is a difficult 
task and many pitfalls exist in uncovering it. Commonly, there are 
agreements about data but disagreements about what such information means. 
A number of technical appendices are included for the aid of persons de- 
siring to examine in detail the data collected and the methods us^ to 
obtain it. 

Where were He ad Start classes (children) at the beginning? 

Tlie first observation of Head Start children was begun as soon as 
practical after the first week of the 1966 summer programs. Because of 
individual, local administration of all Head Start programs, different 



starting dates were common. However, individual pupil information coUec 
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tion was started early in each program. The instruments used were the 
Stanford-Binet (L-M, short form), the Project Head Start Behavior Inven- 
tory, and the (Caldwell-Soule) Preschool Inventory, 

The following table sunmarizes info ma tion obtained using the ve!Ll- 
known and widely-used Stanford-Binet: 

TABLE 1. 

First-Observation of Head Start Classes 
(Stanford-Binet, short form) 

Average actual age of classes = approx. 5 years 9i months old 
Average mental age of classes = approx. 5 years old 
(average all classes, rounded numbers) 

(The 79 classes observed ranged from average mental age equal to 
approx. 4 years old to average mental age equal to approx. 6 years 
months.) 

^ -a- ^ 

On the Project Head Start Behavior Inventory, groups of items are 
scored to produce subscores. To indicate the kinds of information col- 
lected the first such group of items is reproduced below. (See Appendix 
B for all subscores.) Thie purpose of such a Behavior Inventory is de- 
scriptive. It is difficult, however, to interpret such descriptions 
without deciding upon some goal desired or without comparing one group's 
description with another group's description. In the present study, only 
Head Start children were involved so the interpretation presented is from 
first observation to second. (See section on Observed Changes, pp. 13-15.) 
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TABLE 2. 

First Behavior Inventory of Head St art Classes 
(subscbre one, only) 



Itans 

33. Likes to talk w5.th or socialize >d.th 
the teacher 

35. ]!s es.ger to inform other children of 

the e 3 q>eriences he has had 

38. Is usually polite to adults; says 
"Please," "Thank you," etc. 

45. Is wanted as a playmate by other 
children 

7i Often keeps aloof from others because 
he is uninterested, suspicious, or 
bashful 

16. Has little respect for the rights of 
other children; refuses to wait his 
turn, usurps toys other children are 
playing with, etc. 

24. Is reluctant to talk to adults; re- 
sponds verbally only when urged 

37. Is uncooperative in group activities 

* * * 



Siibscore One Data 

Highest possible score = 32 
Lowest possible score = 8 

Highest scoring class = 29 
Lowest scoring class = 17 

Average score of 79 _ 23 
Head Start classes 

(rounded numbers) 



Similarly, groups of items on the Preschool Inventory are scored to 
produce subscores. However, it is also possible to derive a total score 
based upon all of the items in the inventory. Reported below are sample 
items from each of the four subscores in this inventory but with total 
score performance reported rather than subscores. (See Appendix C for all 

scores . ) 



o 
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TABLE 3. 

First Preschool Inventory of Head Start Glasses 
(selected items^ — ^total score) 



Items (examples) 

Subscore one 

When is your birthday? 

Put one car in middle-size box. 

Subscore two 

What time of year is hottest? 
What does policeman do? 

Subscore three 

How many wheels on a wheelbarrow? 
Point to middle one. (object) 

Subscore four 
Draw a triangle. 

Which is heavier — ^brick or shoe? 

* 



Total Score Data 

Highest possible score ~ 90 
Lowest possible score = 0 

Highest scoring class = 70 
Lowest scoring class = 26 

Average score of 79 ^ co 
Head Start classes 

(rounded numbers) 

I 

* -K- 



A generalized sunmary of the information above (and in the Appen- 
dices) to answer the question of where were Head Start classes (children) 
at the beginning of the summer program woxild be: 

The children studied in summer 1966 Head Start programs were gener- 
ally below established and desirable developmental performance on one 
widely*"Used intellTgence test; were generally scoring positively on an 
inventory of behaviors (desired and undesired); and were able to amswer 
correctly about 59 percent of the preschool inventory questions at the 




beginning of the instructional sessions. 



10 



! 

i 



•' •Where were Head Start classes (children) at the end? 

t 

The second individual observation of the same Head Start children 
was scheduled to begin during the next to the last week of the summer 
program (usually eight weeks). This was to allow for adequate time for 
all observations and to keep from losing individuals because of early de- 
parture. The instruments used were the same. The following tables sum- 
marize information obtained on the same classes (children) and the same 
instruments reported earlier. 



TABLE 4. 

Second Observation of Head Start Classes 
(Stanford-Binet, short form) 



Average actual age of classes = approx. 5 years 11 months old 
Average mental age of classes = approx. 5 years months old 



(average all. classes, rounded numbers) 



(The 79 classes observed ranged from average mental age equal 
to approx. 4 years 2 months to average mental age equal to 
approx. 7 years.) 




* * * 



(See table on the following page) 
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TABLE 5. 



Second Behavior Inventory of Head Start Classes 
(subscore one, only) 



Items 

33* Likes to talk with or socialize with 
the teacher 

35. Is eager to inform other children of 
the experiences he has had 

3B, Is usually polite to adults; says 
"Please," "Thank you," etc. 

45. Is wanted as a playmate by other 
children 

7. Often keeps aloof from others because 
he is uninterested, suspicious, or 
bashful 

16 . ffas little respect for the rights of 
other children; refuses to wait his 
turn, usurps toys other children are 
playing with, etc. 

24 . Is reluctant to talk to adults; re- 
sponds verbally only when urged 

37 . Is uncooperative in group acti^ties 



Subscore One Data 

Highest possible score *» 32 
Lowest possible score = B 

Highest scoring class = 30 
Lowest scoring class = 20 

Average score of 79 _ 24 
Head Start classes ^ 

(roimded numbers) 




(See table on the following page) 
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TABLE 6. 

Second Preschool Inventory of Head St art Classes 
(selected items— total score) 



Items (examples) 

Sub score one 

When is your birthday? 

Put one car in middle-size box. 

Subscore two 

What time of year is hottest? 

What does policeman do? 

Subscore three 

Kow many wheels on a wheelbarrow? 
Point to middle one^ (object) 

Subscore four 
Draw a triangle. 

Which is heavier— brick or shoe? 



Total Score Data 

Highest possible score = 90 
Lowest possible score = 0 

Highest scoring' class = 74 
Lowest scoring class == 35 

Average score of 79 _ eg 
Head Start classes 

(romded numbers) 

* * 



To answer the question (where were Head Start classes (children) at 
the end) in a generalized way, based upon the information collected, it 

can be stated; 

The c hildren studied in summer 1966 Head Start progr^ s were gener- 
ally below established and desirable develop m ental performance on or^ 
widely used intelligence test; were generally scoring posit iveP^y on an 
invoi itory of behaviors (desired and undesi r ed) ; and were able to answe r 
correctly sHght.lv more than 6k percent of t h e preschool inventory gpestio ns 



at the end of the instructional sessions. 
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Were changes observed in Head Start classes (children)? 

Although to some people the generalized answers to the questions 
about beginning and ending status of Head Start classes would seem to dic- 
tate the answer to the present question, such is not the case. A coiiQ)ar- 
ison of before and after statements on a point by point base (with accurate, 
comparable numbers) must be made to reveal the differences often hidden by 
gross generalized comparisons. However, because it is .only possible to 
measure human behavior roughly, often two precise measuronents althoiigh 
apparently different may neither be correct; they may be only slightly negative 
and slightly positive descriptions of the same thing. 

Errors from looking at only gross comparisons are avoided by attempt- 
ing precise measurements of people and outcomes. Errors from too much 
dependence upon precise measurement are avoided by statistical analysis. 

The ways of allowing for such measurement errors are well developed in 
scientific work and the details need not delay us here. (See Appendices 
A, B, and C for statistical tests used.) 

In order to answer the question about whether changes were observed in 
Head Start classes (children), we must look at both before and after per- 
formance on a point by point basis, and we must test that any changes so 
revealed are statistically significant changes. 

The following tables place relevant information reported earlier 
and available in the Appendices in position for easy comparison. 






TABLE 7. 

Observation of Head Start Classes (Stanford-Binet, short form) 



First observation 
Second observation 

Statistically 
Significant Gain 



(79 classes) 

Average 
Actual Age 

5 years 9j months 

5 years 11 months 



Average 
Mental Age 

5 yea.rs 

5 years months 



ij months months 

(all rounded values in table) 



Average 

I, Q, 

85 

89t 



* 



TABLE 8. 

Observation of Head Start Classes (Behavior liiventory) 

(79 classes) 



Behavior 

Inventory 


Possible 


First 

Observation 


Second 

Observation 


Statistically 
Significant Ga,in 


Subscore 


Low 


High 


(average all classes, rounded 
numbers) 




1 


8 


32 


23 


24 


yes 


2 


6 


24 


16 


16 


no 


3 


8 


32 


22 


23 


yes 


4 


4 


16 


10 


11 


yes 


5 


8 


.32 


24 


24+ 


yes 


6 


4 


16 


12 


12 


no 


7 


4 


16 


12 


12 


no 


8 


6 


24 


16 


17 


yes 


9 


2 


8 


5 


5+ 


yes 



* * * 
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TABLE 9. 

Observation of Head Start Classes (Preschool Inventory) 

(79 classes) 

Preschool First . Second Statistically 

Inventory Possible Observation Observation Significant Gain 

(average all classes^, rounded 
numbers) 



Subscore 1 


26 


18 


20 


yes 


Sub score 2 


26 


11 


12 


yes 


Sub score 3 


19 


10 


11 


yes 


Subscore 4 


19 


14 


15 


yes 


Total Score 


90 


53 


58 


yes 



* -jf 



To summarize the above information in general terms: 

1. The classes (children) studied in summer 1966 Head Start programs, 
although still below established and desirable developmental perform 
mauofi on the wideiv-used Stanford-Binet intelligence test« performed 
beyond what would be expected on the basis of the time intervening 
between observations. 

2. These same classes (children) on a newly developed inventory of be- 
haviors (Pro.iect Head Start Behavior Inventory) were generally scoring 
positively at the beginning of the instructional sessions and slightly 
more positively at the end. 

3. Summer 1966 Head Start classes (children) on the Preschool Inventory 
obtained higher total scores (and higher subscores) at the end of 



the instructional program than at the beginning. 
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What are the reasonable alternative sources of these observed changes? 

Concern in interpretation of the reported changes mentioned above 
arises from the fact that human beings (especially young children) are 
constantly exposed to many experiences that may influence their behavior 
and learning. For taxample, during the period of time of an investigation 
of the effect of certain school experiences on youngsters, the children 
are also watching television, tallcing to adults and other children, en- 
joying or reacting to experiences in the home and neighborhood. 

lii well controlled experimentation certain procedures may be built 

t 

into the study to assess the effects of these and other experiences in 
order that clear-cut statements may be made about the effect ort children 
of the school experiences being investigated. These procedures generally 
involve random assignment processes and control group methods. 

In the present study random assignment was not possible and appropri- 
ate control group data were not readily collectable within the limitations 
of time and money. Therefore, certain reasonable alternatives must be 
considered in attempting to decide what particular sources of learning and 
changed behavior might account for the gains noted in Head Start classes 
during summer 1966. 

The four reasonable sources of changes in the children studied ares 

(1) Head Start programs 

(2) Maturation 
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(3) Outside experiences (home, play, etc.) 

(4) Testing effects 

Although it will be impossible to decide among these alternatives 
unec^ui vocally (and all probably contribute to the noted gains), it is 
helpful to discuss in general terms the 'fifferent effect to be expected 
when each is the dominant source of change. 

Program changes (such as those introduced by Head Start) most gener- 
ally should result in rather sudden gains on the specific skills, abilities, 
and knowledge provided in ar.iy curriculum. This is nothing n'ore profound 
than saying that children learn what is specifically taught and they 
ought to gain on measures that are directly or indirectly related to the 
instructional content. 

MatiJirational changes refer to gains noted over a period of time on 
aspects of development for which we often cannot identify any instruc- 
tional situation. That is, for example, children may not be able to run 
at one age and then at a later age are observed to be running quite well 
— all without specific instructional aid or intent. An identifying 
characteristic of maturational changes is relative slowness or undiffer- 
entiated acquisition stages before change is noted from one observation 
to another. Therefore, most authorities agree that maturational changes 
are a constant and underlying source of observed changes (especially in 
younger children). Such change processes should be considered whenever 
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substantial periods of times are covered by an investigation. Because 
of the slovmess of maturational processes, it seems unlikely that they 
could account for the gains noted in Head Start children (excepi^ perhaps, 
the gains noted on the Behavior Inventory). 

Another source of change with possibly sudden or drastic results in 
observed behavior, however, is individual experiences outside of the class 
time devoted to Head Start. Such exp^iriences are, in effect, the "curricu- 
lum" of the home and neighborhood and its results may be very much like 
the program or planned experiences in the school, especially the preschool. 
It would be fruitless to argue the case for or against the effect of out- 
side experience during the summer of 1966 without data from children eli- 
gible but not enrolled in summer 1966 Head Start programs. It seems un- 
likely, however, that such outside experiences as might have occurred during 
that summer were substantially different from those experiences which have 
occurred in the past. (These past experiences had produced so little 
effect that Head Start programs were initiated to remedy the deficit.) 

A defensible position ?s that outside experiences undoubtedly contributed 
to the noted gains but cannot account for the unexpected gain in mental 
age, for instance, above and beyond ij months. Future research may pro- 
vide evidence so this question can be decided on a factual basis. 

Testing effects as a possible source of observed changes is at least 
partially eliminated by the statistical tests already reported on the in- 
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formation obtained. The noted and emphasized changes have survived an 
evaluation that takes into account testing fluctuations. There are, 
however, other possible influences of tests on students and teachers 
which are not evaluated by the statistical methods used. These include 
reactions to (or learning from) the tests by both students and teachers, 
the added experience or reaction of test administrators, and variations 
induced by personal reactions between the test administrator and the 
student taking the test. 

It is possible, of course, to defend the idea that even while taking 
a test a child at this age is constantly learning. In particular he is 
learning how to interact and react to adults and new situations. Such 
learning would seem to be an important outcome for Head Start children. 

To be able to state exactly what portion of change is due to this one 
learning experience (and from each of the numerous -other possible sources 
of changed scores) a controlled investigation is necessary. 

In the present case, as noted, rigorous control was not practical 
and therefore mention must be made of several possible sonrces of change 
noted above. It is possible that a case could be made for any of these 
alone or in combination as accounting for a portion of the gains in 

overall class means cited earlier. 

To summarize, it is stated that there are several possible alterna- 
tives as sources of the observed changes in summer 1966 Head Start 




20 



children that should be considered. An extreme position would be that 
all of the noted gains could be attributed to sources other than the pro- 
gram of Head Start; a more realistic position would be that a portion of 
the gain should be attributed to factors other than Head Start programs. 
However, it is not unreasonable to assume on the basis of the information 
reported that the program of Project Head Start did make a difference in 

children. 

Did Head Start classes differ? In what ways? 

To those acquainted with the problems of instruction of any age group, 
the answer to the first question is well known. Yes, Head Start classes, 
as classes of all kinds, did differ from each other in many aspects. Only 
a portion of the many ways in which classes are likely to differ were 
studied. For each of the selected ways in which classes were to be studied 
some schedule or procedure of observation was designed. Tliese information 
collection forms are available in a separate appendix. In general, the 
differences studied may be grouped in four broad areas: 

(1) Teacher's background and experience 

(2) Characteristics of students in the class 

(3) Specific observed experiences of students 

(4) Various school-community-parental attributes 
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The four tables following, although lengthy, simnnarize most of the 
descriptive information col3.ected. Particular portions of each table 
are discussed within the text but the reader is urged to explore all 
information in the tables in order to form his own picture of the ways 
in which Head Start classes varied. 

Variations in teacher characteristics 

Answers to T T specific (questions about the teacher's training and 
experience form the background for attempting a descriptive paragraph 

I 

or two about the instructional staff in summer 1966 Head Start. The 
format of this information coH.ection sheet was simple and direct. No 
teacher needed to spend more than a minute or two in completion of the 
information. A copy of the form is in the Forms Appendix and should be 
examined to see the choice format of this schedule. 

If it was desired that Head Start teachers be experienced, female, 
specially (although briefly) trained for Head Start, and from predomi- 
nantly elementary education college majors, such was largely the 
case. Response summaries in Table 10 show the exact percentages of 

teachers selecting each alternative. 

Most Head Start teachers also had taught preschoolers and the 
educationally disadvantaged prior to the summer 1966 program. About 
41^ stated that they live in the neighborhood served by the Head Start 




22 



TABLE 10. 

Bov Do the Bead Start Classes Vary? 

In tenss of Teacher Background and E]g;>erience 

Bb. of 
Teachers 



local training 
program. 

6- day college 
sponsored 
8-veek college 
sponsored 

Residence - 

not in center 
neighborhood 
in center 

neighborhood 

Humber of Head Start classes taught concurrently 

one 

more than one 



78 



Percentage 



Sex 

male 

female 




78 




5.1 

94.9 


All tea(diing experience - 


first 

some but < 5 yz's* 
> 5 yrs. 


74 




5.4 

25.7 

68.9 


Preschool teaching e^q^rience 


•> 

first 

some but ^ 5 yrs. 
» 5 yrs. 


74 




36.5 
41.9 

21.6 


Previous e^qperience vith Head Start - 

none 

yes, but not as 
teacher- in- 
charge 

as teacher- in 
charge 


78 




59.0 

7.7 

33*3 


Experience vorking vith disadvantaged children - 

first 

some but ^ 5 yrs. 
^ 5 yrs. 


78 




21.8 

43.6 

34.6 


Hi^st level of education - 


high school 
some college 
Bacheloi*s degree 
seme graduate vork 

npuswoxo vrx owwvv. 


73 


j 

$ 


1.4 

8.2 

43.8 

30.1 

16.4 


Undergraduate major - 


elementary educ. 
preschool educ. 
other 


70 




70.0 

5.7 

24.3 


Graduate major - 


elementary educ. 

p^coCuCOX 

other 


32 




62.5 

6.3 

31.3 


^cial training for Head Start - 

none 


68 




8.8 



10.3 

76.5 

4.4 

59.0 

41.0 

93.6 

6.4 



78 
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center in which they worked. It is iiiteresting that over 16 % held a 
Master’s Degree or above. Few teachers were responsible for more than 
one class during the sumner program. 

3n summary, although classes of course have only one particular 
teacher, teachers of Head Start classes were generally prepared and 
experienced. This means that the chance of any particular child having 
a prepared and experienced teacher for the sunmer Head Start program 
was very high. 

Variations in characteristics of pupils in Head Start classes 

Although differences among classes because of differences among 
children have been implicit in data presented earlier in this report, 
it is appropriate to look at these data once again to eiiQ)hasize such 
variation. In particular, classes varied in the average value obtained 
on the Stanford-Binet, the Behavior Inventory, and the Preschool Inven- 
tory. In addition, classes may also be described as varying at both the 
first and second collection of information with these same instruments 
as well as in amount of change on the same three. Table 11 presents in 
summary form this information about differences in classes. 

Other differences in pupils were collected on the student identi- 
fication sheet of the Preschool Inventory. Thus, it was possible to 
calculate proportions or percentages of students in each class with 



o 
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TABLE 11. 

How 10 the Head Start Classes Vary? 
In terms of Pupil Characteristics 
(N = T9 classes) 



Binet M.A. - pretest mean 
posttest mean 
change mean 

Binet I.Q. - pretest mean 
posttest mean 
change mean 

Preschool Inventory !• Pers.-soc. resp. 

pretest mean 
posttest mean 
change mean 

2 . Associative Vocahulary 
pretest mean 
posttest mean 
change mean 

3* Concept - numerical 
pretest mean 
posttest mean 
change mean 

4. Concept - sensory 
pretest mean 
posttest mean 
change mean 

Total score 
pretest mean 
posttest mean 
change mean 

Behavior Inventory Score 1 

pretest mean 
posttest mean 
change mean 
Score 2 
pretest mean 
posttest mean 
change mean 
Score 3 
pretest mean 
posttest mean 
change mean 
Score 4 
pretest mean 
posttest mean 
change mean 
Score 5 
pretest me i 
posttest mean 
change mean 
Score 6 

pretest mean 
posttest mean 
change mean 



Mean 


Std.Dev. 


Lowest 


Hipest 


of Means 


of Means 


Mean 


Mean 


59.74 


6.63 


45.50 


80.40 


63 . 1*8 


6.80 


49.73 


84 . 4 o 


3.74 


1.84 


- 2.00 


7.38 


84.88 


7.78 


67.21 


106.70 


89 c 44 


8.06 


72.91 


110.50 


4.56 


2.97 


- 2.80 


13.31 


18.46 


2.30 


10.00 


22.62 


19.72 


2.03 


13.62 


22.88 


1.26 


1.18 


-1.08 


6.54 


10.79 


2.79 


3.40 


16.80 


12.48 


3.26 


4.70 


19.40 


1.69 


1.63 


-3.00 


4.73 


10.12 


2.13 


5.20 


14.50 


11.08 


2,09 


6.25 


14.80 


.95 


.98 


-.69 


3.31 


13.96 


2.19 


7.40 


17.67 


14.83 


1.90 


9.00 


17.87 


.87 


.82 


-.50 


3.38 


53.34 


8.80 


26.00 


70.40 


58.11 


8.63 


35.12 


74.33 


4.77 


3.03 


- 1.86 


15.85 


22.78 


2.37 


17.18 


29.00 


24.13 


2.19 


20.45 


30.19 


1.35 


1.73 


- 2.00 


7.38 


15.82 


1.22 


12.23 


18.00 


16.00 


1.10 


12.69 • 


19.12 


.18 


.89 


- 2.00 


2.25 


21.86 


2.16 


17.60 


30.00 


23.10 


2.30 


18.10 


29.30 


1.24 


1.73 


- 2.11 


7.23 


10.31 


1.27 


6.71 


13.40 


10.76 


1.18 


7.67 


13.23 


.45 


1.07 


- 2.00 


3.86 


24.00 


2.35 


18.67 


30.00 


24.42 


2.28 


19.00 


29.08 


.42 


1.63 


-2.77 


5.25 


11.99 


1.07 


9.54 


14.70 


12.19 


l.l 4 


10.22 


14.90 


.20 


.95 


- 2.00 


3.31 



Score 7 
pretest mean 
posttest mean 
change mean 
Score 8 
pretest mean 
posttest mean 
change mean 
Score 9 
pretest mean 
posttest mean 
chasige mean 

Mean age in months 



Variance of ages of children in the class 
(in mos. ) 



Percentage of children in the class whose 
major language is English 

Percentage of hoys in the class 
Percentage of Negroes in the class 



Percentage of Puerto Ricans in the class 



Percentage of Mexican- Americans in the class 



Mean 
of Means 


Std.Dev. 
of Means 


Lowest 

Mean 


Hi^^est 

Mean 


11.6? 

11.77 

.15 


1.15 

1.23 

.89 


9.10 

9.09 

-2.25 


15.20 

15.00 

2 . 29 * 


16.07 

16.78 

.71 


1.27 
1.52 

1.28 


13.23 

12.92 

-2.69 


18.64 

21.90 

5.00 


5.16 

5.U0 

.24 


.52 

.59 

.48 


4.25 

4,38 

-1.11 


6.60 

7.15 

1.85 


69.38 


6.48 


49.75 


77.77 


tfesn of 
Variances 
30 . 42 - 


Std.Dev.of 

Variances 

27 .i ^9 


Lowest 

Variance 

’M’ 


Highest 

Variance 

122 . n 


tfean of 
Percents 


Std.Dev.of 

Percents 


Lowest 

Percent 


Highest 

Percent 


92.76 


21.41 


0 

( 2 )t of 
classes) 


100 

{Q 2 ff> of 
classes ) 


52.54 


15.32 


10.00 


90.91 


51.04 


42.76 


0 

of 

classes) 


100 

( 29 Si of 
classes ) 


.55 


3.14 


0 

(9656 of 
classes) 


25.00 


10.06 


27.19 


0 

( 84?6 of 
classes) 


100 
( 5 ?t of 
classes) 


.22 


1.37 


a 

(985^ of 
classes) 


100 
M of 
classes) 



Percentage of Orientals in the class 
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certain distinguishing characteristics. Among these characteristics were 
mean age of pupils in each class and the spread of ages in a class. In- 
terestingly, although the ages of children in Head Start classes were gener- 
ally about 5 years 9 months, there was variation from one class with an 
average age just over 4 years to one with an average age just about 6J years. 

Another example was the percentage of pupils with English as their 
major language. Some 82^ of the classes were completely English speaking. 
However, 2 percent of classes were composed of students whose major language 
was not Ehglish. 

Specific observed experiences 

A Classroom Observation Form was designed to systematize the collec- 
tion of information during the requested "intensive classroom observation" 
phase of summer 1966 Project Head Start evaluation. Within the purposes 
of the evaluation it would have been feasible to send educated observers 
into each of the selected classroom and to ask them to report back in 
essay form what they had seen. Such reports have been collected before 
and, when cautiously interpreted, have aided in the formulation of judg- 
ments about programs and suggested hypotheses to be tested under more 
rigorous conditions. In the present instance, it was felt that a small 
step toward, more objective information might be reasonable. 



TABLE 12. 
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How Do the Head Start Classes Vary? 

In terms of dassrocm Program, Climate, and Organization 
(Based on 62 classes for which data from two ohse'rvations are available) 



Adult/pupil ratio 

Rating of adequacy of physical 
facilities (sum of two ratings, 
each on 5“Point scale from 1 low 
to 3 high; hic^est possible score 
= 10 ) 

Rating of availability of instructional 
and other materials (same type of 
score as above) 

Rating of quality of teacher^from 2 low 
to 10 high (same type of score as 
above) 

Rating of general emotional climate, 
from 2 unsupportive to 10 supportive 
(same type of score as above) 

Rating of organization of activities, 
from 2 unstructured to 10 structured 
(same type of score as above) 

Rating of content of activities, ftm 2 
playfuJ. stress to 10 informational, 
stress (same type of score as above) 

Percentage of observed classroom behavior 
(average frcm two observations) falling 
into the category of~- 

child’s choice of activity 
physical affection shown by teacher 
or aide 

child Joining another child's 
activity 

child encouraged to talk 
child laughing out loud 
teacher or aide reading aloud 
child's talk interrupted by teacher 
or aide 

child's yawning or resting (not 
during rest period) 
child admonished about talking 
child crying or pouting 
child hitting another, child 
child's lack of interest 



Mean 


Std.Dev. 


Lowest 


Highest 


.20 


.07 


.09 


.40 


6.52 


1.66 


4 


10 

(lOjt of 
classes) 


6.55 


-l.Ulf 


4 


10 

(85^ of 
classc'j ) 


6.71 


1.52 


4 


10 

(5?t of 
teachers) 


8.06 


1.2k 


4 


10 

{15$ of 
classes) 


6.65 


1.9k . 


2 

{5iof 

classes) 


10 

{3i> of 
classes) 


5.50 


1.3k 


2 

(59& of 
classes) 


10 

{2$ot 

classes) 



18.72 


12.04 


0 


60.71 


35.78 


8.67 


0 


39.00 


13.92 


11.63 


0 


66.63 


13.44 


9.22 


0 


48.79 


14.43 


8.69 


0 


36.75 


3.84 


4.21 


0 


18.06 


.50 


1.64 


0 


11.12 


2.74 


3.23 


0 


12.50 


3.24 


4.35 


0 


. 15.32 


3.77 


3.83 


0 


14.16 


4.35 


5.05 


0 


20.87 


8.23 


7.80 


0 


39.60 
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Score for classroom based on first 
11 categories below and two ob- 
servations (possible score range 
0 - 22 ) 



Kean Std.Dev . Lowest Highe st 

18.15 2.96 10 22 

(1316 of 

classes) 



During one of During both 

two observations observations 



Percentage of classrooms where the 
following were observed— 

no case in which class could be 
described as apathetic 
no case of teacher using sarcasm 
or ridicule with children 
evidence that each child felt 
accepted in the class 
attention to isolated children 
children talking to each other 
spontaneously' and after 
no case of teadier or aide .spending 
long periods talking, tell in g 
while children said nothing 

no period when no one seemed to know 
what to do 

opportunities for children to speak 
before a group 

exhilarated, excited classroom 
no children who did not talk to 
anyone 

teacher and children plan and c<xnplete 
activity 



6.5 

11.3 
12.9 

12.9 

16.1 

24.2 

14.5 
24.2 

19.4 

30.6 

41.9 



93.5 

88.7 

85.5 

83.9 

80.6 

72.6 



71.0 



64.5 

58.1 

53.2 

48.4 



teacher punish child or class with 
words or actions 



37.1 



45.2 



o 

ERIC 
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Consequently, the Classroom Observation Form (included in the Forms 
Appendix) was written, revised on the basis of consultant comments and 
trial, and then utilized in the summer 1966 Project Head Start evaluation. 
Because the summer 1966 evaluation was the first large-scale use of the 
form, careful attention to the data collection situation must be given 
during interpretation of the data. 

It was hoped that observations of Head Start classes by representa- 
tives of ETS would result in several specific behavioral ways tc distin- 
guish among classes. Evidence that the particular behaviors did differen- 
tiate among classes is contained in Table 12. Such summary data indicate 
that the behaviors observed occur in different frequencies and that 
classes vary on any particular behavior in expected ways. Several general 
statements are. of interest: 

*1. . Pupil choice of activities and oppoHunity to interact with 
other children were generally observed. 

2. Sicouragement for verbal activities was strong in most class- 
rooms . 

3. General trends for both specific behaviors and more global 
observed activities were in directions endorsed by most child 
development experts. 

Some descriptive highlights from the classroom observation form in- 
dicate that observers saw evidence that each child felt accepted in the 
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class (94/S first observation; 90^ second observation); that fevf class- 
rooms were described as apathetic (3^ first and second observation); and 
that children were given opportunities to speak before the whole group or 
snail groups of other children (81^ first observation^ 73^ second obser- 
vation) > 

Tji general, the desired direction on each of the 12 global descrip- 
tive questions was selected by no lower than 60 % of the observers on any 
occasion. Most percentages were higher and ranged from 60 to 97 % in the 
direction endorsed by child development experts in general discussions 
of desirable activities and environments for preschool children. 

If it was desired that Head Start classes be supportive emotional 
climates for pupils, the observers report that most teachers were very 
supportive; no teacher was rated as highly unsupport ive. 

The structure or organization of the classroom experiences was 
also reported as generally structured and this is in conjunction with 
the report that most classes generally stressed playful aspects of ac- 
tivities. Such terms may be difficult to define but as indicators of 
general emphases of programs they seem adequate. Highly professionally 
skilled judges were later used to estimate the reliability of the rating 
scales and such study indicates the general concepts communicate re- 
liably. 






«« 
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Parent interview schedule 

The parent interview schedule was developed in response to the re- 
quest to obtain information about "parental evaluation of and involvement 
in the program." The content and format of the instrument were predicated 
on four assumptions: 

1. The more the parent knows about the program in which her child 
is enrolled the more "involved" she is. 

2. "Whether she would want to send another child to Head Start" is 
more relevant to her evaluation of the program than her response to such 
a general question as "What do you think of Head Start?" 

3. Communication with parents of Head Start children may be diffi- 
cult, and thus the interviewer should have a gre^t deal of freedom and 
flexibility in asking questions. 

4. The interview should be as brief and unthreatening as possible; 
it will be less threatening if the atmosphere is more one of obtaining 
information about the center than about the parent. 

As would be expected, average class scores showed a restricted range: 

9 to 14.5 (Table 13). Altho^ogh these average scores are the data of the pre- 
sent classroom analysis, it is of interest to review briefly the individual 
responses of the 886 parents on whom complete interview data were obtained: 

Questions 

Three-fourths or more of the parents had accurate information about whether 
their children had been given medical and dental examinations. 
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Questions ^ ... 

3 ^ 5 ^ 11 ; About 90/S of the parents knew something about field trips in the program, 

said they talked to their childroi about what they did at Head Start, and 



knew about the meals the center provided their children. 



However, relatively few { 30 %') could state (within 3) how many i>^*ldren 
were in their children's classes. 

10 6; Over 80^ knew their children's teachers' names, and 70 % said they had 
actually talked to the teachers about their children. 

About the same percentage indicated they had talked to relatives and 
friends about their children's being in Head Start. 



7, S t However, many fewer (only about 30^) said that they had talked to Head 
Start social or medical workers about their children. (Whether such 
workers were in fact available was not determined.) 

12: About 30^ of the parents had not visited the Head Start center, but only 

a tiny fraction of those expressed no desire to do so. Of the 70 % who had 
visited the center, about 10^ had actually worked there (as aides, helping 
on trips, etc.). 

23, l/i : Almost all parents (over 90^) felt that Head Start had made a difference in 
their children, but only about half said it had made changes in their own 
lives. 



1^: Almost all the parents (97^) said they would want to "do it again'’—send 







another child to Head Start. 



TABLE 13 
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Eow Do the Head Start Classes Vary? 
In terms of Parent Characteristics 



Ko.of 

Classes 

Median annual inccme for the class T5 
(■where 1 =**1^000, 2 = l^OOC -1^999^ 

3 - 2,000-2,999, ^ = 3,000-3,999, 

5 = 4,000-4,999, 6 = 5,000-5,999, 

7 = 6,000-7,999, 8 = 8,000-9,999, 

9 = 10,000 or more) 



Kean of Std*De'v* 

Medians of Medians 

3.98 1.18 

(about $3,500) 



Lowest Highest 

Median Median 



1.43 6.25 

(about $1,000) (about $5,750) 



Mean of Std.Dev. Lowest 

Means of Means Mean 



Highest 

Mean 



Mean "Involvement" score, based on 
interview (possible range 0-17) 77 H»75 



9.00 



14.50 



Percentage of noninterviewable 
mothers in the class 



O 



ERIC 



Mean Std.Dev^ 
of of Lowest 

Percentages Percentages Percentage 



Highest 

Percentage 



79 8.59 17«45 



0 



(579^ of 
classes) 



100 
(3)6 of 
classes) 
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These conclusions, of course, cannot be generalized to the "non- 
interviewable" mothers, of which there were one or more in 32 of the 77 
classes which form the N of this study. Because it was suspected that 
mothers who were hard to track down for interview (i.e., could not be 
located in three visits) may be different from the other mothers, the 
percentage of them in each class was included as a variable in the large 
correlational matrix. 



Comments of classroom observers 

Before going on to examine whether there were or were not associa- 
tions between the specific differences described in the preceding tables 
and the amount of change noted in classes (children), some sub elective 
comments collected from the observers act uall y present in ‘che 79 Head 
Start classes may be of interest. It should be noted that these comments 
are not meant to represent the full range of activities and incidents 
that occurred and a particular incident may have occurred only once in 
all of the summer 1966 program while others may have been frequent events. 

For their human interest then the following comments (selected by 
opening to observation schedules in a pile like a deck of cards) are 



noted: 
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Teacher showed me a drawing a boy had made. Coordination so poor when 
he entered he could not feed himself. Made short circling line marks on 
paper. Today for first time filled his page with continuous curving lines 
across page. Is now feeding himself. Teacher commented that 2 more weeks 
would have meant much to this child. 

Two girls playing with wagon and trike tied together for a long time. 

A third girl wants a turn. Aide gives a little talk on sharing, explain- 
ing that in school we share. First two girls look bewildered and both 
leave in complete surrender. They are back later, however. 

One little boy, Danny, came up and asked me if I knew that his daddy had 
gotten him a dog. He stayed with me for several minutes. 

One boy brought a sack of pretty rocks. The teacher developed a good 
arithmetic lesson. The children estimated the number of rocks, then 
grouped the rocks in fours to count them. The teacher also brought in 
enumeration and comparison as she shared the rocks. 

One child was noticeably quiet— she had been fitted for glasses the 
previous day— this observer felt the child was seeing things for the 
first time — she was especially fascinated by books and pieces of construc- 
tion paper. 

(6) The use of real telephones by the children who were able to make calls 
to each other by pressing a bell elicited one conversation between two 
boys regarding the worth of girls— after a lengthy discussion which was 
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humorous they concluded that boys really are the superior sex— or in their 
words "good for more." This equipment was one of the most popular in the 
room and the teacher was always aware of how it was being used — ^the 
children were encouraged to use good speech— and manners. 

(7) Two paper plates labelled "big" and "little." Children one at a time 
sorted two sizes of beans for a mixed collection. One girl did success- 

i fully. Teacher tried to get "problem" boy to do this— he refused. 

(8) All day Johnny craved and demanded attention. While sitting at the 
teacher* s feet he asked to go live with her. She told him she would very 

;; 

much like that, but pointed out that his family would be unhappy and that 
she had children of her own and no extra bed. He said that he had to 
sleep on the floor without "cover" and he didn't live with his mama and 
daddy anyway. 

(9) Students are well supervised during their eating periods. They are en- 
couraged to eat all their food but not rushed. Have learned to discard 

? 

straws and cartons in proper containers, return trays, and push chairs 

I 

up to table. 

(10) One child sustained a f”t on his hand while playing with a steel chair. 

I He received immediate sympathy and support from all his classmates. 

(U) One little boy was present a few days and has been absent for two weeks. 
The difference in his actions and these of the other children could be a 
good measurement of what Head Start can do for children. 

I. 

i ERIC 



A very positive approach taken by the teacher including the use of a 
Polaroid camera on the field trip— which excited the children when they 
saw the pictures and — further seemed to give them a favorable source of 
group identity. 

Perhaps these few are enough to give the flavor of the human inter- 
actions among students and between students and teachers and to mske^ 
once again, the point that classes do differ in what occurs within them. 
Obviously, only a few of the more readily observed and recorded differences 
among classes have been reported in the more objective tables. The area 
where this report can. claim to speak with any authority (and that limited 
by the design and analysis used) is in those obj*^ective variables reported 

above. 

Further research is usually needed and a good investigation raises 
additional questions beyond those considered within its own structure. 
Fu3?ther investigation by many different researchers with different ques- 
tions and orientations should provide further information of genuine 
interest and value in evaluation of the effects of Head Start programs 



on children. 
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Was there an association between specific differences and amount of change? 

A portion of the present investigation was to examine the possibility 
of relationships between specific differences among classrooms and amount 
of change. A detailed account of the observed change and the ways in 
which classes varied has been given. This section of the report will pre- 
sent information about the associations examined by the method of corre- 
lational analysis. In effect, for each of a number of specific pupil, 
program and school-community characteristics, the question was asked: 

Is variation in one characteristic associated with variation in the other 
characteristic under examiiiation? Obviously, for a study such as this 
one which examined so many particular characteristics of pupils and pro- 
grams a very large number of such associations (or correlations) are 
possible. The actual tota] correlation matrix calc\ilated runs several 
score of pages and includes several thousiind correlation coefficients. 

The total table is therefore not reproduced with this report but will be 
made available through appropriate sources. 

The table on the following page reports statistically significant 
correlations between several possible pretest and/or assignment variables 
and difference scores on the three main information collection instruments. 
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TABLE lU. 

Pretetting or Assltguent Variables 
vs. 

Difference on 3 instruments 
(All filtered Correlations Significant 
at .05 or Qreater—TWo Tsiled Tost) 



Stanford- Project Head Start 

Bjnat. T»M Preschool Inventory Behavior Inventory 

Pre MA 79 

Pre I.Q. 79 



-.33 

-.2? -.24 



PRE PRESCHOOL INV. 
Subscore 1 


79 


-.48 


-.23 -.49 -.28 


" 2 


79 


-.24 


-.43 -.24 


3 


79 


-.24 


.25 -.27 -.47 


" ‘4 


79 




.24 -.52 


Total (T) 


79 


•-.31 


-.51 -.23 


PRE BEHAVIOR INV. 
Subscore 1 


79 






" 2 


79 






" 3 


79 






" 4 


79 






.. 5 


79 


.24 




" 6 


79 






.. 7 


79 






•' 8 


79 






•' 9 


79 






Median Class Income 


75 • 


-.25 


• 

1 

• 

1 

• 

1 


Teacher Exp. (1) 


74 






Teacher Sex (2) 


78 


.22 . 




Teacher Ifiidergrad. 
Major (4) 


70 


-.24 


-.27 -.23 


Teacher Exp. Pre- 
school (9) 


74 


-.25 


to 

CM 

• 

1 

CM 

• 

1 


Age Variance 


79 


■ 


.31 


Proportion of Eng. 
Spuddng 


79 




.29 -.27 -.37 


Proportion of 
Negro 


79 


-.28 -.25 




Proportion of 
Puerto Ricans 


79 






Proportion of Mex.- 
American 


79 




-.34 .29 .42 


Proportion of 
Oriental 


79 






Proportion of Com- 
bined Non-Mhite, 
Non-Negro 


79 




-.37 .26 .41 


Material Rt. 


62 






Non-interviewable 

Mothers 


79 




.28 .26 



-.47 



-.32 

-.45 

-.28 



-.39 



-.24 



-.23 

-.48 

-.23 -.32 
-.29 



-.28 



-.24 



.36 



.26 



-.37 -.39 



-.40 -.30 
-.51 -.40 
-.23 -.39 
-.29 -.38 
-.22 -.27 
-.22 



.24 



-.33 



-.32 -.23 

-.32 -.26 -.24 



-.36 -.22 

-.30 



-.26 -.29 



-.29 



-.26 -.29 



.32 
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One of the first conclusions possible after examination of the pre- 
ceding table of associations between difference scores on the Stanford- 
Binet, the Behavior Invw*itory, and the Preschool Inventory is that rela- 
tively few characteristics of teachers, classroom experiences, and school- 
community variations are associated with such class gains. 

Because association, in and of itself, does not identify causation 
it is best to interpret any correlAtions cautiously. It j” particularly 
important to examine cautiously correlations that are significar. - but of 
low numerical value. This means that the correlations reported, although 
useful as indices of possible areas for more controlled investigation, 
are only suggestive of such areas, not definitive. 

Two areas seem worth some comment. First the cluster of negative asso- 
ciations between the pretest Preschool Inventory and class gains on the Pre- 
school Inventory may indicate its usefu3uess as an entrance measui'e to Project 
Head Start classes. Low scores on the pretest were associated with high gains 
on the Preschool Inventory for the classes studied. 

Second, the cluster of associations between the pretest Behavior Inven- 
tory and gains on itself may also indicate its usefulness for a similar 
purpose. However, because the Behavior Inventory must be completed after 
some few days of acquaintance with the ir. dividual child, this instrument 
may be more generally practically useful as an indicator to teachers about 
who should receive special attention during the program, once the child has 



been admitted. 



TABLE 15. 

Trefttnent Variables (Observed or Rated) 



vs. 



Difference on 3 Instruments 
(All Ehtered Correlations Significant 
at .05 or Greater—TWo Tailed Teat) 
N 6l«^3 



Obaer=< 

vation 

Choice -of Activity 1 

Crying or Pouting 1 

Joining Activity 1 

Teaching Reading 
Aloud 1 

Physical Affection 2 

Crying- or Pouting 2 



Stanford^ 
Binet L»M 

MA Mi 
.26 .25 



Preschool Inventory. 



Project Head Start 
Behavior Ihvantoi»v 



Jt- -I. -i- JL ±. JL 



.27 .28 

.25 



-.35 



-.31 



-.26 



-.26 



-.27 -.28 



-.25 



Joining Activity 2 




-.26 


-.33 


Child Laughing 2 




.33 


.26 


Child Hitting 2 -.28 


.30 




.25 


Joining Activity Av.1+2 




-.26 


-.37 


Child Tawnihg Av.1+2 


.28 






Child laughing Av.1+2 




.31 


•26 


Child Hitting. Av.1+2 








Teacher-children 








Plan 1 *30 








Teacher Use Sarcasm 1 




-.26 


-.25 



.33 



.25 



-.26 



Isolated Children 1 -.26 -.33 

Apathetic Class 1 

Ibdiilarated Class 1 

Acceptance of All 1 -.26 

Punishment 1 .27 

Teacher Talks Long 
Periods 1 

Apathetic Clase- 2 

Acceptance of All 2 

Pxmishment 2 

Teacher-children 

■ Plan 1+2 .25 

Isolated Childi*en 1+2 -.30 

. Apathetic Class 1+2 

Acceptance ol' All 1+2 -.26 

Teacher Talks Long 
Periods 1+2 

RATING!: 



-.33 



-.25 



-.27 



-.26 



-.25 



-.26 



-.42 



-.35 



Baotion Climate 


1 


Organization 


1 —.25 


Content 


1 -.35 -.31 


Teacher 


2 -.29' -.29 


Organization 


2 -.37 -.29 


Content 


2 -.31 


Baotion Climate 


1+2- 


Organization 


1+2 -.31 


Content 


1+2 -.38 -.31 



.32 



.26 



-.27 -.33 -.26 
.30 



-.28 



-.30 



.25 



.28 



.27 



.27 
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The preceding table reports significant correlations between several 
observed and rated treatment variables and difference scores on the three 
output instruments. 

The lack of a large nuniber or discernible pattern of significant 
correlations in the preceding table leads to the conclusion that only a 
few of the treatment variabljs observed or aspects of the classroom 
rated are indicative of areas for further fruitful investigation. 

'*iie negative correlations between ratings of the structured-un- 
structured organization of class activities differences on 
the Stanford-Binet may be of interest. This is especially so when the 
negative correlations between ratings of the informational-playful as- 
pect and differences on the Stanford-Binet are also considered. A tenta- 
tive suggestion may be taken from these data that a controlled investi- 
gation should be made among highly formal, factml programs and less 
formal, play centered programs. The correlations here suggest that more 
formal, factual programs are not associated with as much gain on the 
Stanford-Binet as less formal, playful programs. Various other signifi- 
cant associations not reported in Tables 14 and 15 are contained in the 
total intercorrelation matrix. However, further examination of these 
when the input jid treatment variables are equivocal is mostly of theo- 
retical or descriptive interest. The purpose of this summary report is 
to indicate the main, important findings. Therefore, theoretical 



o 
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im^jlications of the total matrix -will be reported, as appropriate, 
elsewhere. The descriptive interest has probably been well served 
by the portion of this report dealing with various kinds of de- 
scriptive data. 

Of what use is the information described and discussed above? 

The judgmental nature of interpretation of information has been 
mentioned earlier in this report. However, it seems in^wrtant in an in- 
vestigation of this kind to present one or two possible interpretations. 
This may help to clarify the information presented and to stimulate dis- 
cussion about the more fundamental questions that produced the study in 
the first place. 

One of the major fundamental questions facing the Project Head 
Start research and evaluation division has been the question of whether 
or not the massive efforts of Project Head Start are having an effect on 
children. Obviously, no one study can answer this question definitively. 
Nevertheless, the infonnation collected in this study indicates that 
positive, consistent and developmentally desirable effects were observed 
during the sunmer 1966 program. It is, of course, not possible to tell 
from the information collection design used the actual, contribution of 
various possible sources of change to these overall observed effects, 

A second major question of interest undoubtedly has been whether 




or not there were particular program variations which seemed to be more 
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successful than others. The information presented on associations between 
various characteristics and pupil outcomes indicates only very tentatively 
and with large question marks the possibility that less formal, playful 
programs may lead to greater gains on one instrument, 3h addition, two other 
instruments seem most likely to predict gain on themselves under, the un- . 
differentiated, effect of Pro;ject Head Start programs. 

On the basis of the information presented it should be possible to bring 
to bear something more than subjective opinion to decisions on two major 
questions,. These questions are: 

1, Should sumner Project Head Start programs be continued? 

2c Should reconmendations be made to local program directors about 
the nature and content of programs? 

These questions (deliberately phrased in the language of value or choice 
decisions) are not answered by the ii?,formation presented, but the infor- 
mation herein can aid ir. arriving at answers to these questions. No 
further Justification seems necessary for scientific information collection 



than this role as aid to human choice behavior. 
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Forms Appendix 



Information Collection Forms 
and Field Director’s Manual 

( St anf ord-Binet — not included ) 
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PROJECT MATERIALS * 



Y*ek «dadni8ter«d Adaiiiisttrad br 
Inst 3 !*uMnt and subiactCs) (Trinlmia level) 


Estimated time 


Disposition 


Special notes 


Stanford-HLnet (i960) 
Short Font lr)( 


2-3 and 7-8 
each chili 


Trained examiner— 
Project Persccnel 
(Eb^rience with 
preschool im>ortant) 


20-40 minutes 
per child 


Kail cosq^ted sets 
of record* foxes to 
ETS in 3rd and 8th 

week 


Use Wright's method 
of abbreviation same 
examiner each ad- 
ministration 


Preschool toventory 
(CaldwU) 


2-3 and 7-8 
each child. 


Preschool, Primaiy, 
or other teacher who 
are Project Personnel 


15-30 minntes 
per child 


As above 


In a class, caq>lata 
BinSts before start- 
ing Inventory. Sams 
examdnsr each ad- 
sdnistration 


Behavior Inventory 
(Zigler) 


2-3 and 7 
each child 


Teacher in charge 
after briefing by 
Project Personnel 


5-6 minutes 
per child 


As above 




Classroon Obeervation 
Fom 


3 and 6-7 

each class 


Experienced Preschool, 
or Primary teacher, 
not from same district 
—Project Personnel 


Full class 
session 


Kail both obser- 
vations to ETS in 
8th wi.'ek 


Same oboerver both 
administrations 


Teacher Informtioa 


6 

each tea >r 
in charge 


Teacher in charge — 
Project Personnel can 
pick up immediately 


3 minutes 


Mail to ETS in 
8th week 


-• 


Parent Interview 


6-7 

mother or 

female house- 
hold heJd 
each child 


Person or persons 
ichc can psrsnt 

confidence — ^Project • 
Personnel 


10-15 adnutes 
per parent 


Kail to ETS in 
^h week 


Hone odministraticn 
SK>st desirable- 
note deviations 


Director's Report 
Form 


10 

each 

classroom 


Project Field Director 




Hail to ETS by 
nth week 


To be forwarded 
by ETS 


Materials Tor Classroom Study only - 
will foUcw. 


- If Norms Study materials are to be used by your personnel. 


information thereon 
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IRW-PROJECT MATERIALS EEING HANDLED -BT PROJECT PERSOMEL 








Week administered Administered ly 
InstruMnt. and sub.iect(s) (arinlmun level) 


Estimated time 


Disposition 


Special notes 


Center Facilities 
and Resoxirces 
Inventory 


6 

riach center 


Center Personnel 




KaU to ETS in 
8th week 


To be forwarded 
byETS 


Kedical/Osntal 

Information 


7 

each child 


Center medical personnel 


Kail to ETS in 
8th week 


To be forwarded 
byETS 


Parent Participation 
Record 


7 

each CoaSC 


Senior teacher 




Man to ETS in 
8th week 


To be forwarded 
byKTS 


Class Resister 


Early as 
possible 
each class 
triplicate 
alphabetised 


Senior teacher 


20 minutes 


One fom for class 
one fom GEO/Census 
one SNiil to ETS 


If class numbers 
are not yet assigned 
by Washington — Project 
Personnel assign them 
in coordination with 
Center Personnel 
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•ad proc««d In an •Itazmtinc fashion toward th« calling and. basal 
IfiTals in ordar that succasses nsy ba distributad throu^out tha 
tasting period. Wian tasting is coixplatad, it is suggastad that 
tha child ba- given soma sinpla task idiera success is virtually assured. 
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10. If more than 50 units remin, t«ks first 50 as saaiae. 

All centsrc than ware asksd to nans two classrooM (nuabers ona 
and two on thslr list of all claasaa) to tha study being conducted. 
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HEAD START CENTERS 
AND PROJECT CONSULTANTS 



Auburn, Alabama 
Phenix City, Alabama 
Prairie, Alabama 
Fayetteville, Arkansas 
Los Angeles, California (2) 
Sacramento, California (2) 
Gainesville, Georgia 
Waynesboro, Georgia 
Waukegan, Illinois 
South Bend, Indiana 
Baton Rouge, Louisiana (2) 
Benton Harbor, Michigan 
Detroit, Michigan (2) 
Duluth, Minnesota 
Royalton,., l<!innesota 
Grenada, Mississippi 
New York, New York (2) 

Snow Hill, North Carolina 
Caldwell, Ohio 
Cleveland, Ohio (2) 

Dayton, Ohio 
Ironton, Ohio 
Nashua, New Hampshire 
Uhrichsville, Ohio 
Columbia, South Carolina 
Rockhill, South Carolina 
Monterey, Tennessee 
Beaumont, Texas 
George West, Texas 
Heame, Texas 
Navasota, Texas 
San Antonio, Texas (2) 
Tyler, Texas 

Christiansburg, Virginia 
Salem, Virginia 
Seattle, Washington (2) 
Charleston, West Virginia 
Fairmont, West Virginia 
Huntington, West Virginia 



William D. Spears 

William D. Spears 

Tliomas Staton 

Wilson Kimbrough 

Philip Montez 

William Rohwer 

Warren Findley, Paul L. Wood 

Warren Findley, Paul L. Wood 

James A. Mooney 

N. J. Pallone 

H. E. Chesteen, Jr., Robert A. 

N. J. Pallone 

Norman Kagan 

Charles W. McKain 

Albert Luker 

Dorothy Rice 

Lillian Restaino 

John Clarke 

Edwin Titus 

Melvin E. Allerhand 

Charles H. Scheidler 

Elizabeth Wolf 

Robert Duryea 

Katherine Sober 

Lawrence Giles 

La.wrence Giles 

Hoyle D. Lawson 

Dale L. Johnson 

J. Pierce- Jones 

J. Pierce- Jones 

J. P3,erce-Jones 

J. Pierce-Jones, Robert Boger 

John T. Lewis 

Robert D. Childers 

Robert D. Childers 

Audrey R. Holliday 

Elizabeth Wolf 

Philip Comer 

Elizabeth Wolf 



Perkins 






Technical Appendix A 



Stanford-Dinet (short form) 



(Mental Age and I.Q. Class Means) 
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Technical Appendix B 



Pro.iect Head Start 
Behavior Inventory 



9 Sub scores on 
Behavior Description Inventory 




Behavior Jr.vfefttory 



Pr«t«3t Koans hy CXastfroosi 



«ASiS ritOCESSEO 
mNimm vAL*«iE 
9IMIHW V«L«E 
SUM OF SCSMES 
SUM sec* SCOMES 
MEAN 

STNC* CEVi tRt 
S?MC« UEVl OHl) 



7« 

ll.lSli 

2f-.0CCC 

41417.793C 

22.77S2 

2.35SS 

2.3749 



Pretest Means by Classroom 



CASES FMOCESSfC 
NSMIMIW mUE 
MAXIMUM VALUE 
SUM CF SC8KES 
SUM SCO. SCMES 
AN 

STNO. CEVi tM3 
STNCi OEVJ iM-n 



79 

12.23CI 

IC.CCOC 

1249.94411 

19E79.3S64 

15.1173 

1.2049 

1.2124 



Posttest Means by Classroom 



CASES FROCESSEC 


« 


79 


MINIMUM VALUE 


• 


2C.4949 


MAX MUM VALUE 


o 


3C.1875 


SUM OF sooces 


9 


1909.9046 


SUN SfiC. SCORES 


9 


46393.109C 


MEAN 


9 


24.1254 


STRCi CSV! INI 


9 


2.1713 


STNOl OEVi OKI) 


9 


2.1852 



Posttest Keans by Classroom 



CASES FMOCESSEC 
MINIMUM VALUE 
MAXIMUM VALUE 
SUM OF SC0K2S 
SUM SOD. SCORES 
MEAN 

STNCe OEVi CM) 
STNCa CEVi IN- It 



79 

12.4923 

19.12SC 

1243.7192 

2C31C.2395 

19.9944 

1.0979 

1.1049 



Difference Means by Classroooi 



CASES FROCESSEC 


9 


79 


MINIMUM VALUE 


9 


•2.CCCC 


MAXIMUM VALUE 
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7.3846 


SUM OF SCORES 


9 


106.6654 


SUK SOO. SCONES 


9 


376.5731 


MEAN 


8 


1.3902 


STNCi CEVi INI 


9 


1.7157 


SYNCi CEVa OKI) 


9 


1.7267 



Difference Means by Classroom 



CASES FROCESSEC 


9 


79 


HINIMUM VALUE 


•9 


»2.COOC 


MAXIMUM VALUE 


9 


2.25CC 


SUN OF SCORES 


9 


14.1531 


CUM see. SCORES 


9 


64.2C17 


MEAN 


9 


C.1792 


STNCa OEVi IN) 
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C.8835 


STNC. CEVi OKI) 


9 


C.8891 



Snbscore 1. Subscore 2. 



TB 2 

Behavior Inventory 



Pretest Means by Classroom 



CASES MOCESSEC 
MINIMUM VALUE 
MAXWUH VALUE 
SUM OF SCORES 
SUM see. SCORES 
MEAN 

STNCi CEVa INI 
STNC. CEVa CN^lt 



79 

17.6CCC 
3C.CCCC 
1726.7901 
3f ICE. 7444 
21.8981 
2.1477 
2.1614 



Pretest Means by Classroom 

CASES FROCESSEC • 

MINIMUM VALLE « 

MAXIMUM VALLE • 

SUM OF SCORES « 

SUM sac. SCORES > 

MEAN * 

STMRa CEVa INI « 

STNC. CEVa CM- 1 1 » 



79 

6.7143 

13.4CCC 

ei4»4072 

£521.9849 

1C.3C9C 

1.2644 

1.2725 



Posttest Means by Classroom 



CASES FROCESSEC 
MINIMUM VALUE 
MAXIMUM VALUE 
SUM OF SCORES 
SUM SCO. SCORES 
MEAN 

STNO. OEVi INI 
STNO; CEVi CN-n 



79 

It.lCCC 

29.3CCC 

1824.6359 

42557.C43C 

23.0967 

2.2894 

2.3C4C 



Posttest Keans by Classroom 



CASES FROCESSEC 


9 


79 


MINIMUM VALLE 


9 


7.6667 


MAXIMUM VALUE 


9 


13.23C8 


SUM OF SCORES 


9 


E5Co3231 


SUR SOC. SCORES 


9 


926C.8164 


CEAN 


SI 


1C.7636 


STNC. CEVi IN) 


9 


1.17CE 


STNCi CEVi IN>1) 




1.1783 



Difference Neann hy Classrocia 

79 

• 2.1111 
7.2308 
97.8455 
354.5052 
1.2386 
1.7195 
1.7295 



SvA>acore 3« 



Difference Means by Classroom 



CASES FROCESSEC 


9 


79 


MINIMUM VALUE 


9 


•2.CC0C 


MAXIMUM VALUE 


9 


3.3571 


SUM OF SCORES 


9 


35.9159 


SUN SOC. SCORES 


9 


IC5.4S32 


MEAN 


9 


C.4546 


STNC. OEVi IN) 


9 


1.0621 


STNC. OEVi OKI) 


9 


1.0689 



Subscore U. 



CASES FROCESSEC 
MINIMUM VALUE 
MAXIMUM VALLE 
SUN OF SCONES 
SUN see. SCORES 
MEAN 

STNC. CEVi INI 
STNC. CEVa fN>ll 



T3 3 



Behk/lor Inventory 



Pretest Means by ClassrooB 



C*SES fROCfcSSEC ■ 
MINIMUI VM.UC » 
nUXlHUM VAUE ■ 
SUM OF SCORES ■ 
SOM SCO. SCORES » 

RERR • 
STHC. CEVfc IHI « 
STUD. CEVi » 



7S 

18 . 66*7 

3C.CCCC 

if96.176C 

26.CC22 

2.3372 

2.3521 



Pretest Keans by Classroom 



CASES FROCESSEC 
RIIIIMUR VALUE 
RAXIHOR VALLE 
SUR OF SCORES 
sun SQC. SCORES 
KEAN 

STNC. CEVa (Nl 
STNG. CEV. 8H-1) 



79 

9.9315 

1«.7CCC 

967.C558 

11462.C866 

U.9ftv 

1.C59E 

1.C666 



Posttest Moans by Classroom 



CASES FROCiSSEC 
MNIHUM VALUE 

raxihum value 
SUM OF SCORES 
SUM SSC. SCORES 

HEAR 

STNC. KEVfc (Rl ^ 
STNCk CEVa IR-1» 



79 

19.CCCC 

29.C769 

1929.C569 

675CE.6C53 

26.61E4 

2.261C 

2.2756 



Posttest Means by Classroom 



CASES FROCESSEC 
MINIMUM VALUE 
MAXIMUM VALUE 
SUM OF SCORES 
SUN see. SCORES 
MEAN 

STNC* OEV* iMi 
STNC. DEVa (PHll 



79 

1C.2222 

16.9CCC 

963.C6C3 

11E61.S467 

12.19C6 

1.1337 

1.14C9 



Difference Means by Classroom 



CASES PRQCESSEC 


9 


7^ 


MINIMUM VALUE 


9 




MAXIMUM VALLE 


9 


S«2SCC 


SUM OF SCORES 
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32o88CS 


SUM see. SCORES 


9 


22Co8^62 


MEAN 


9 


€•41^2 


STNG. GEV. INI 


9 


i«6m 


STNC. CEVi IN- 11 


9 




Subscore 5- 





Difference Moans by Claasroom 



CASES PROCESSEC 


9 


79 


MINIMUM VALLE 


n 


-2.CCCC 


MAXIMUM VALLE 


u 


3.3C7? 


SUM OF SCORES 
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16.CC65 


SUM sec. SCORES 
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73.3IC3 


MEAN 


9 


C.2C26 


STNC* CEV. INI 
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C.9622 


STNC. CEV. I»^ll 


9 


C.96I3 



Subscore 6. 



TB A 

Behavior Inventory 



Pretest Means by Classroom 



CASES PRQCESSEC 
MINIMUM VALLE 
MAXIMUM VALLE 
SUM OF SCORES 
SUN see. SCORES 
MEAN 

STNC. CEVa iN) 
STNC. CEVi IN- II 



79 

9.1CCC 

15.2CCC 

917.6763 

1C763.2721 

11.6162 

1.1661 

1.1516 
• . 



Pretest Means by Classroem 



CASES PRCCESSEC 
MINIMUM VALLE 
MAXIMLM VALLE 
SUN OF SCORES 
SUM see. SCORES 
MEAN 

STNCa CEV. IM 
STNC. CEV. CN-n 



. 79 

13.23C8 

1E.6366 

1269.2917 

2C519.9E32 

16.C67C 

1*2666 

1.2725 



Posttest Means by Classroom 



CASES FROCESSEC 
MINIMUM VALUE 
MAXIMLM VALUE 
SUM OF SCORES 
SUM see. SCORES 
REAM 

STNC. CEVa INI 
STNG. GEVL IN- II 



79 

9.CCCC 

If.CCCC 

929.5212 

IIC53.9869 

11.7661 

1.217E 

1.2256 



Posttest Means by Classroom 



CASES PRQCESSEC 
MINIMUM VALLE 
MAXIMUM VALUE 
SUM OF SCORES 
SUM see. SCORES 
MEAN 

STNC. CEV. IN) 
STNC. CEV. iN-n 



79 

12.9231 

P1.9CCC 

13>5c3659 

22615.3633 

16.7766 

I.5C93 

1.S19C 



Difference Means by Classroom 



CASES PROCESSEC 


9 


79 


MINIMUM VALLt 


9 


-2.25CC 


MAXIMUM VALLE 


9 


2.2657 


SUM OF SCORES 


9 


11.6668 


SUM sec. SCCRES 


9 


63.8626 


MEAN 


9 


C.1699 


STNC. CEV. INI 


9 


C.I866 


STNC. CEV. (N-U 


9 


C.692C 



Difference Means by Claosroom 



CASES PROCESSEC « 79 

MINIMUM VALLE ■ -2.6<323 

MAXIMUM VALLE « 5.CCCC 

SUM OF SCORES « 56.C76I 

CUM see. SCORES » 166.7677 

MiAN « . C.1C96 

STNC. CEVa IM « 1.2677 

STNC. CEV. IN- 11 » 1.2 J9t 



Subscore 7 



Subscora 8 
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Technical Appendix C 



Preschool Inventory 
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4 Subscores and Total from 
\Preschool Performance Question^ 



Preschool Inventory 
tci^l 

Reliability Estlaates (all scores) 

Pretest Means by Classroom (Preschool Inventory) 
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TC 3 

Preschool Inventorj 



Pretest Means by ClAssroon 



Pretest Means by Classroom 



CASCS PAOCESSEC 
•INIKUI VAIOC 
MAXIHUH VALtE 
CUM OF SCORES 
CUN SQOo SCORES 
MEAN 

CTNE« CEVa INI 
STNCl CEV. flHlI 



79 

IC.OOOC 

22.A2SC 

14Sf.S403 

27341.A155 

1I.4C25 

2.2C73 

2.302C 



CASCS PROCESSED 
MIAIMUH VALUE 
MAXIMUM VALUE 
SUN OF SCORES 
SUM SODo SCOPES 
MEAN 

STNCi CEV» CM) 
STNCL OEVa CN-1) 



7f 

3.4SCC 
1E.8CCC 
•S2«7fC2 . 
9E12«Clt4 
1C.7947 
2.77CI 
2o7tC5 



Posttest Means by Clnssroooi 



Posttest Means Classrooei 



CASCS PROCESSED 
MINIMUM VALUE 
MAXMHiti VALUE 
SUM OF SCORES 
SUM SOD. SCORES 
MEAN 

STNCa DEV. IN} 
STNC« OEVL IN-1) 



79 

13.S25C 

22.S75C 

1S57.742A 

31C37.3A25 

19W1I3 

2.017C 

2.0299 



CASCS PROCESSED 
MINIMUM VALUE 
MAXIMUM VALUE 
SUM OF SCORES 
SUM SQC. SCORES 
MEAN 

STNCi DEVa IN) 
STNCL OEVi IN-1) 



79 

4.7C0C 

19.4C0C 

9I9.9979 

13133.A999 

12.4109 

3.2313 

3.2990 



Difference Keans by Classroom 



CASES PROCESSED > 79 

MINIMUM VA«.UE > -1.0833 

MAXIMUM VALUE > 6.5385 

SUM OF SCORES > 99.2C23 

SUM SOD. SCORES « 233.4312 

MEAN » 1.2557 

STND. CEVl IN) « 1.1739 

STNE. CEVl IN-1) a 1.1814 



Difference Means by Classroom 

79 

-3.0CCC 
4.7273 
133.1777 
43C.8817 
1.685E 
1.6163 
1.6266 



CASES PROCESSED 
MINIMUM VALUE 
MAXIMUM VALUE 
SUM OF SCORES 
SUM SOD. SCORES 
MEAN 

STND. DEV. IN) 
STND. CEVi IN-1) 



Subscore !• Subscore 2« 



TC k 

Preschool Inventory 



Pretest Kaans by Classroom 



Pretest Means by Classroom 



CASES PROCESSED 
MINIMUM VALLE 
MAXIMUM VALLE 
SUM OF SCORES 
SUM see. SCORES 
MEAN 

STND. DEV. IN) 
STNCa DEV. IN-1) 



79 

5.2CCC 

14.SCCC 

799.6826 

E449.2823 

1C.1226 

2.1182 

2.1317 



CASES PROCESSED 
MINIMUM VALtE 
MAXIMUM VALUE 
SUM OF SCORES 
SUM SOD. SCORES 
MEAN 

S7NC. DEV. IN) 
STND. DEV. IN-1) 



79 

7.4CCC 

17.6667 

11C2.7C46 

15766.366C 

13.9583 

2.1773 

2.1912 



Posttest Keans by Classroom 



CASES PROCESSED 
MINIMUM VALLE 
MAXIMUM VALUE 
SUM OF SCORES 
SUM see. SCORES 
MEAN 

STNC. DEV. IN) 
STNC. DEV. IN-1) 



79 

6.25CC 

14.8CCC 

€74.9931 

1CC3I.9738 

11.C759 

2.C766 

2.C899 



Posttest Means by Classroom 



CASES FROCESSEC 
::iNlMUM VALLE 
MAXIMUM VALUE 
SUM OF SCORES 
SUM see. SCORES 
MEAN 

STNC. OEVa IN) 
S7NC. DEV. lN-1) 



79 

9.CCCC 

17.8647 

1171.7283 

17661.CC49 

14.832C 

1.8891 

1.9C12 



Difference Means by Classroom 
CASES FROCESSEC > 

MINIMUM VALLE > 

UAXIMUM VALUE 
SUM OF SCORES • 

SUM see. SCORES > 

MEAM > 

STNC. OEVa IN) * 

O STNC. GEV. IN-1) > 

ERIC 



79 

-C.6923 

3.3C77 

7S.31C5 

146.15C7 

C.9533 

C.97C2 

C.9764 



Difference Keans by Classroom 



CASES FROCESSEC • 79 

MINIPUM VALLE • -C.3CCC 

MAXIMUM VALLE > 3.3S46 

SUM OF SCORES « 69.C23T 

SUM see. SCORES > 112.559C 

MEAN » C.E737 

STNC. CEV. IN) « C.8133 

STNC. DEV; IN-1) > C.8185 



Subscore 3 



Subscore h 






Technical Appendix D 



Si/niificance Tests for Mean Differences 
(Complete Data) 

N = 79 



Stanford-Binet M& 


t = 18.05 






(df = 78) 








Stanford-Binet I.Q. 


t = 13.63 






(df = 78) 








Behavior Inventory Subscore 1 


t = 


7.08 




Sub score 2 


t == 


1.87 




Sub score 3 


t = 


6.09 




Subscore 4 


t = 


3.70 




Subscore 5 


t = 


2.15 




Subscore 6 


t = 


1.82 




Subscore 7 


t = 


1.68 




Subscore 8 


t = 


■4.60 




Sub score 9 


t = 


4.46 


Preschool Inventory Subscore 1 


t = 


9.45 




Subscore 2 


t = 


9.21 




Subscore 3 


t = 


8.68 




Subscore 4 


t = 


9.49 




Total 


t = 


13.99 



Formula Used 
t - Test: 





(Post^-Pre^) 

N 






N 



Let = Post^-Pre^ 
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ERIC 



Technical Appendix E 



Variables 1-4S 

A Portion o£ the Correlation Matrix 

(Total matrix will be available as 
separate document and as computer tape) 
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C.0556 


C.12S6 


C.E7E7 


RESICUAL 






14.5556 


34.CCCC 


0.4261 






TCTAl 






5C.E333 


53.CCCC 
















JICOE YARIATICR 


MTFCUT 


JUCCE VARIATICN 


RELIABIUTY 


ACRCSS 


JC06ES 


c.eces 




C.7SEE 




RELiAeam 


PER 


JLCGE 


C.5846 




0^5656 





CCPRELAIlGh EBCIICh 

CeSERV JIDCES 

CESERV 
JLCCES 



l.CCCC C.dU? 

C-EUl l.CCCC 




CBCIMlZ/tTION 





SIM OF SQUARES 


R.C.F. 


PEAR SCUARE 


EETHSEM STIMULI 


66.75S3 


17.CCCC 


3.9270 


tmMN STIMULI 


22.CCCC 


36.CCCC 


0.6111 


8ETMEEN JUCCES 


C.7C37 


2.CCCC 


0.3519 


RESICUAL 


21.2963 


34.CCCG 


0.6264 


TOTAL 


EE. 7593 


53.CCC0 





f H4TIC PRCB F CUTER 



C*5tn C.E754 



WITH JtCGE VRRIdllCR RITFCUT JUCCC VRRIRTICH 



RELIAeailY ACROSS JCC6ES C.8A44 

RELIAEILllY PER JLC6E C.6440 



0iC4CS 

046372 



CCRRELATION PAIR IX 0R6AM7A7ICR 

CeSERV J106ES 

CeSERV l.CCCC C.7675 

JUCCES C.767S l.CCCC 



1? 2 



CCNTENT 





SL1> OF SOL'ARES 


K.G.F. 


PEAK SCUARE 


F MATIO 


PR08 f CRTER 


EETHEEM STIMULI 


5E.CS26 


17.CCC0 


3.2996 






WITHIN STIMULI 


25.3333 


36.CCC0 


. 0.8148 






BETWEEN JUDGES 


3.37C4 


2.CC00 


1.6852 


212M8 


C.1256 


KE6I0UAL 


2S.5E3C 


34.COOO 


0.7636 






TOTAL 


€5.4255 


53. COCO 









KITH JUG6E V«HI«T1CK 



HITHCUT JUCCE VMIATION 



RELM81LITV ACROSS JIOGES 0.7531 

REilABILITY PER JIOGE C.5041 



0a»54 



CCRRELATIQN MATRIX COKTEM 

OBSERV JtOGES 

OeSERV l.CCCC C.73SI 

JUC6ES C.T35C laCCCC 



REFSaSICE: 

B. J; VJINER, StatlstlcAl Principles In Experimental Design . New York; McGraw-Hill, 1962, 

pp. 124-132. 



O 

ERIC 







BETWEEN STIMULI 
WITWIN STIMULI 
BETWEEN jUOfi&S 
RESIDUAL 
TOTAL 



SUN OF SQUARES 



0.7405 

0.3038 

0.2958 

1.0443 



TP3 



N.O.F. MEAN SQUARE 



60.0000 

61.0000 

"I.OCW 

60.0000 

121.0000 



0.0123 

0.0050 

o;oo8o 

0.0049 



F RATIO 



r.‘6235 



FROB F 6RTER 



0.2075 



WITH JU06E VARIATION 



WITHOUT JUOQE VARIATION 



RELIABILITY ACROSS JUDGES 



R EL lAHITITTO JDD5T 



0.5965 






0.6C06 

U.4291 



BEHAVR 



BETWEEN STIMULI 
WITHIN STIMULI 

between judges 

RESIDUAL 

TCTm. 



SUN OF SQUARES 



1.7692 

0.4604 

Q-.OOST 

0.4571 

2.2296 



N.O.F. 



MEAN SQUARE 



60.0000 
61.0000 
■ ”i:;oooD' 
60.0000 
121.0000 



0.0295 

0.C075 

"C.0033 

0.0076 



F RATIO 



0.4320 



PROB F GRTER 



0.5135 



WITH JUDGE VARIATION 



WITHOUT JUDGE VARIATION 



RELIABILITY ACROSS JUDGES 
RELTAftTLlTY Ffi TOOeC 



0.7441 

0. 5924 



0.7416 

O.TBOA' 



BEHAVR 



SUN OF SQUARES 



N.O.F. 



MEAN SQUARE 



F RATIO 



PROB F GRTER 



O 

ERIC 



BETWEEN STIMULI 0.8305 

WITHIN STIMULI 0.4500 


60.0000 

61.0000 


0.0138 

0.C074 


“o;o«ir 


0HS6W 


IfTwliSl JUDGES ~ "■ "OiDODT 
RESIDUAL 0.4494 

TOTAL 1.2806 


noooo . 
60.0000 
121.0000 


"O'.OOOT 

0.0075 


WITH JUDGE VARIATION 


WITHOUT 


JUDGE VARIATION 




RELUBILITY ACROSS JUDGES 


0.4670 




0.4589 




REL Ij5rSIi.ITV PHTOTiSr 


Q.3046 




0«297B 




BEHAVR 4 










SUM OF SQUARES 


N.O.F. MEAN SQUARE 


F RATIO PROB F GRTER 


BETWEEN STIMULI 0.1683 

WITHIN STIMULI 0.0794 


60.0000 

61.0000 


0.0028 

0.0013 


Ij.2411'- ■■ ■ 


■ — 


TETSEEN JUKES' — D^OTWS - 

RESIOUAL G.0791 

TOTAL 0.2477 


l«vvw 

60.0000 

121.0000 


0^0003 

0.0013 


UITH JUOGE VARIATION 


WITHOUT 


JUDGE VARIATION 




RELIABILITY ACROSS JUDGES 

Eitrmru t tv »» umiF 


0.5357 
0.3659 




0.S299 

0.3604 





SEKAVIl 



5 



TF4 



SIM OF SOUARES 


N.D.F. MEAN SQUARE 


F RATIO 


FROB F GRTER 


■ETIIEEN STIMULI 
MITHIN STIMULI 


0.228B 

0.1236 


60.0000 

61.0000 


0.0U3B 

0.0020 


‘5.5613 


* 5.5549 


BETWEEN JUOttS; 

RESICUAL 

TOTAL 


O.uOOt 

0.1235 

0.3523 


l.DGOD 

60.0000 

121.0000 


O.OODl 

0.0021 




WITH JUDGE VARIATION 


WITHOUT JUDGE VARIATION 


RELIABILITY ACROSS JU06ES 


0.46B7 




0.4604 




RiLiiiiTnTY'Tiir 'SfMseB 


0.3061 




M.2N^r 




BEWAVR 6_. 


SUN OF SQUARES 


N.D.F. MEAN SQUARE 


r RATIO 


FROB F GRTER 


BETWEEN STIMULI 
WITHIN STIMULI 
BETWEEN JUiSei^' 
RESIDUAL 
TOTAL 


1.0319 

0.4344 


60.0000 

61.0000 


0.0172 

0.0071 




0.945B “ "■ 


- ff.OOOIT' 

0.4344 

1.4663 


- I.'OOOO 

60.0000 

121.0000 


— 050005" 
0.0072 


"TT.OOAT 




WITH JUOW VARIATION 


WIT^T 


JUDGE VARIATION 


RELIABILITY ACROSS JUDGES 


0.5B59 




0.5791 
D.'4075' 


^ M ... * 


RgLTASlLTrt-RBrJliOCE 


0.4144 






BEHAVR T _ 












SUM OF SQUARES 


N.D.F. MEAN SQUME 


F RATIO 


FROB F GRTER 


BETWEEN STIMULI 
WITHIN STIMULI 

BET^lt»^fu6aS^~ 

RESIDUAL 

TOTAL 


1.6116 

0.2649 

-0;:;iras3~ 

0. 2646 

1. B765 


60.0000 

61.0000 

r.oooo 

60.0000 

121.0000 


0.0269 
.0.0043 
' 0^0003 
0.0044 


“555644 ■ 


o.BOor 




WITH JUDGE VARIATION 


WITHOUT 


JUDGE VARIATI^ 


RELIABILITY ACROSS JUDGES 


0.B3B3 




0.B35B 




REL&AGlLkTV RUR J1»CE 


^ 0.7216 




0;Drify 


* 


BEHAVR • 














SUN OF SQUARES 


N.O.F. MEAN SQUARE 


F RATIO 


FROB F GRTER 


BETWEEN STIMULI 
WITHIN STIMULI 


0.1261 

0.0966 


60.0000 

6^.0000 


0.0021 

0.0016 






“TTiriii w ^siC£s~ 

RESIDUAL 

TOTAL 


"050514“ 

0.0951 

0.2227 


1.0000 

60.0000 

121.0000 


055014 

0.0016 


0.9093 






WITH JUDGE VARIATION 


WITHOUT 


JUDGE VARIATION 


?r RELIABlLltt ACROSS JUDGES 


0.2470 




0«»2499 




^ iTELiAAIltfV m JUK£ 


0.1459 




0.1407 





BEHAVR 9 


TF 5 








SUN OF SQUARES 


N.O.F. MEAN SQUARE 


F RATIO 


FRM F GRTER 


BETWEEN STIMULI 0.9059 

WITHIN STIMULI 0.4256 


60.0000 

61.MK 


0.0151 

0.0070 


0;O04T 


'0.9455 


BETWEEN JUKES 0^9000 

RESIDUAL 0.4256 

TOTAL 1.3316 


1.0000 

60.MM 

121.00W 


0.0000 

0.0071 


WITH 


JUDGE VARIATION 


WITHOUT JUDGE VARIATION 


RaiABiLlTV ACROSS JUKES 


0.5379 




0.5302 




RaiABILlTY FER JUD6E 


0«3679 




0.3600 




BEHAVR 10 










SUN OF SQUARES 


N.D.F. MEAN 


SQUARE 


F RATIO 


PRK F GRTER 


BETWEEN STIMULI 0.3074 

WITHIN STIMULI 0.1546 


60.0000 

61.0000 


0.0051 

0.0025 


r.Z55Z 


• a.Z65Z 


between JU06ES Tf;0037 

RESIDUAL 0.1514 

TOTAL 0.4620 


~i.oooo' ■ 

60.MM 

121.0000 


0.0032 

0.0025 


WITH JUOSE VARIATION 


WITHOUT 


JUDGE VARIATION 


RaiABILITV ACROSS JUDGES 


0.5052 




0.5073 




RELIAWILITT RER JUDGE 


0.33B0 




■0.3399 




BEHAVR 11 










SUN OF SQUARES 


N.D.F. MEAN SQUARE 


1* RATIO 


PROB F GRTER 


BETWEEN STIMULI 0.2155 

WITHIN STIMULI s0.0934 


60.0000 

61.0000 


0.0036 

C.0015 






Between JUNES w.vko 

RESIDUAL 0.0934 

TOTAL 0.30B9 


i.OQOQ 

60.0000 

121.0000 


ijcwOOw 

0.0016 


0.0242 


0^8769 


WITH JUDGE VARIATION 


WITHOUT 


JUDGE VARIATION 


RELIABILITV ACRKS JUKES 


0.5737 




0.564B 


• 


reliabIlITV Per JiiuiiE 


0.4023 




^ C.3v59 




BEHAVR 12 










SUN OF SQUARES 


N.D.F. MEAN SQUARE 


? RATIO 


PRK F GRTER 


BETWEEN STIMULI 0.0327 

WITHIN STIMULI 0.0125 


60.0000 

61.M00 

• 


0.0005 

0.0002 






"lETilEEN JUDGES 0.0002 

RESIDUAL 0.0123 

TOTAL 0.0432 


1.0000 

60.00M 

121.00K 


v.oooic 

0.0002 


1.0945 


9^299 f 


WITH JUDGE VARIATION 


WITHOUT 


JUDGE VARIATION 




0 .« 24 « 

0«%541 



mUllLlTV ACKOSS JUKES 

AaiAAILITV JUKE 



0.A240 

0.433F 



